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Abstract 

Long-wave  infrared  (LWIR)  hyperspectral  imaging  sensors  are  widely 
used  for  the  detection  and  identification  of  released  chemical  agents  in  many 
civilian  and  military  applications.  Current  hyperspectral  system  capabilities 
are  limited  by  variation  in  the  background  clutter  as  opposed  to  the  physics 
of  photon  detection.  Hence,  the  development  of  statistical  models  for  back¬ 
ground  clutter  and  optimum  signal  processing  algorithms  that  exploit  these 
models  are  essential  for  the  design  of  practical  systems  that  satisfy  user’s 
requirements.  This  paper  describes  a  signal  processing  system  for  the  detec¬ 
tion  and  identification  of  released  chemical  agents  developed  at  MIT  Lincoln 
Laboratory.  We  discuss  the  underlying  signal  models,  key  detection  and  iden¬ 
tification  algorithms,  and  some  areas  where  the  signal  processing  community 
could  contribute. 


1  Introduction 

Standoff  detection  of  chemical  warfare  agents  (CWAs)  is  necessary  when  physical 
separation  is  required  to  put  people  and  assets  outside  the  zone  of  severe  damage. 
An  important  class  of  standoff  sensors  for  CWAs  is  based  on  the  principles  of 
passive  infrared  (IR)  spectroscopy.  Typical  standoff  CWA  sensors  [5,  2]  utilize 
passive  imaging  spectroscopy  in  the  LWIR  atmospheric  window  (8-13/mi).  The 
LWIR  region  is  well  suited  for  gas-sensing  applications  because  of  the  relative 
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transparency  of  the  atmosphere  at  these  wavelengths  and  the  presence  of  unique 
identifying  spectral  signatures  for  a  wide  range  of  chemicals. 

In  this  paper,  we  describe  and  demonstrate  the  operation  of  a  complete  auto¬ 
mated  system  for  the  detection  of  chemical  clouds  using  an  LWIR  imaging  spec¬ 
trometer.  We  start  with  the  description  of  a  physics-based  signal  model  that  pro¬ 
vides  the  basis  for  the  development  of  the  required  signal  processing  algorithms. 
Then,  we  provide  a  brief  description  of  the  signal  and  clutter  models,  detection 
algorithms,  constant  false  alarm  threshold  selection,  discrimination-identification 
algorithms,  spatial  false  alarm  mitigation,  and  experimental  results  using  data  sets 
collected  by  a  Telops  FIRST  hyperspectral  (FTIR)  sensor  on  an  acetic  acid  explo¬ 
sive  release  at  the  Dugway  Proving  Ground  in  Utah.  Due  to  space  limitations,  the 
description  of  the  various  signal  processing  algorithms  will  be  concise.  More  ex¬ 
perimental  results  demonstrating  the  performance  of  the  automated  system,  in  the 
form  of  movies,  will  be  shown  at  the  conference  presentation. 

2  Physics-Based  Radiance  Signal  Model 


3-1  aver  MoHpI  Atmosphere 


Figure  1:  Three-layer  plume  radiance  transfer  model. 

The  physical  basis  for  gas  detection  in  LWIR  can  be  explained  with  the  following 
simplified  model  [2]  (see  Figure  1) 

Lon(X)  -  Loff(A)  =  [1  -  Tp( A)]  Ta( X)  [B( X,  Tp)  -  Lb(X )]  (1) 

where  Lon( A)  is  the  radiance  reaching  the  sensor  when  the  plume  is  present,  L0ff(A) 
is  the  radiance  reaching  the  sensor  when  the  plume  is  absent,  ra(  A)  is  the  atmo¬ 
spheric  transmission  between  the  chemical  cloud  and  the  sensor,  Lb( A)  the  radi¬ 
ance  of  the  background,  B{ A,  Tp)  is  the  Planck  function  evaluated  at  the  plume 
temperature,  and 

Tp( A)  =  exp  [— ce(A)  x  CL]  (2) 
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is  the  plume  transmission  function  as  expressed  by  Beer’s  law.  We  note  that 
all  quantities  in  (1)  and  (2)  are  functions  of  wavelength  A  or  equivalently  the 
wavenumber  u.  Natural  backgrounds  include  low-angle  sky,  mountains,  vegeta¬ 
tion,  urban  environments,  etc.  All  of  these  backgrounds  emit  infrared  radiation  in 
the  7-14  pm  spectral  region. 

The  function  a(A),  which  is  known  as  the  absorption  coefficient  spectrum,  is 
unique  for  each  gaseous  chemical  and  can  be  used  as  a  spectral  fingerprint.  The 
quantity  CL,  which  is  called  the  concentration  pathlength,  is  the  product  of  two 
terms:  the  term  L,  which  is  the  length  along  the  sensor  boresight  that  represents 
the  depth  of  the  cloud,  and  the  term  C,  which  is  the  average  concentration  along 
that  pathlength. 

The  exponential  relationship  between  the  signal  of  interest  cc(A)  x  CL  and  the 
sensor-measured  differential  radiance  (spectral  contrast)  Lon(A)  —  L0ff(A),  makes 
the  detection  and  identification  of  gaseous  chemicals  a  challenging  problem.  How¬ 
ever,  in  many  practical  situation  we  can  make  the  following  assumptions: 

•  The  plume  is  optically  thin,  that  is,  CL  1.  In  this  case,  we  can  use  the 
following  linear  approximation  of  Beer’s  law:  rp( A)  ~  1  —  a(A)  x  CL. 

•  The  emissivity  of  the  background  in  the  vicinity  of  significant  gas  absorption 
features  is  a  smooth  curve.  Then,  we  can  use  the  approximation  Lj,( A)  ~ 
B(X,Tb). 

•  We  can  use  a  local  linear  approximation  of  Planck’s  function  about  the  plume 
temperature  (valid  for  \  TP  —  7),  less  than  30  degrees  C). 

Under  these  conditions,  we  can  show  that  [2] 

Lon(X)  «  (const  x  CL  x  AT)ra(A)a(A)  +  Loff( A)  (3) 

which  provides  the  basis  for  the  development  of  the  detection  and  identification 
algorithms  used  in  this  paper. 

3  Target  and  Clutter  Modeling 

Equation  (3)  is  a  linear  relationship,  which  can  be  expressed  in  vector  form  by 
sampling  at  K  wavelengths  Ai,  A2, . . . ,  A k,  determined  by  the  characteristics  of 
the  sensor.  The  results  is  the  following  linear  signal  model 

x  =  as  +  v  (4) 


where 
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x  =  [Lon(Ai) .  ..Lon( Xk)]t 

a  =  const  x  CL  x  AT 

s  =  [ra(Ai)a(Ai)  . . .  Ta(\K)a(\K)}T 

v  =  [-Loff(Ai) . . .  Loff(AA-)]T 


The  spectral  signature  s  is  determined  using  measurements  of  a(Xk)  from  high 
resolution  spectral  libraries  and  predicted  values  of  ra(  A&)  obtained  using  the  at¬ 
mospheric  transmission  code  MODTRAN. 

The  background  clutter  is  modeled  using  a  multivariatef-elliptically  contoured 
distribution  with  density  function 


f(x) 


1  +  -(x 

V 


l±)T  R  1(a; 


(5) 


where  T  (  )  is  the  Gamma  function.  The  number  of  degrees  of  freedom  v  controls 
the  tails  of  the  distribution:  v  =  1  leads  to  the  multivariate  Cauchy  distribution 
(heavier  tails),  whereas  as  v  — ►  oo  the  ^-distribution  approaches  the  multivariate 
normal  distribution  (lighter  tails).  The  mean  and  covariance  of  x  are  given  by 
E{x)  =  /v,  and  Cov(cc)  =  -^R,  v  >  3,  respectively.  The  quadratic  form  in  (9)  is 
distributed  as  an  F-distribution 


52  =  ~(x-  rY  R  l(x  -  At)  ~  Fk,l 


(6) 


with  K  and  v  degrees  of  freedom.  The  value  of  v  controls  the  thickness  of  the  dis¬ 
tribution’s  tails.  The  estimation  of  these  models  from  real  data,  which  is  illustrated 
in  Figure  2,  is  discussed  in  [3]. 


4  Detection  Algorithms 


The  signal  model  (4)  describes  how  the  presence  of  plume  changes  the  radiance  v 
of  a  background  pixel.  This  change,  which  is  known  as  radiance  contrast,  can  be 
exploited  to  detect  the  presence  of  a  CWA  using  statistical  detection  techniques. 
We  have  found  out  that  the  matched  filter  detector 


Umf 


sTtb  1(x  -  flb) 
s^s 


(V) 


and  the  adaptive  cosine/coherence  estimator  (ACE) 


DACE  = 


(sTI]~1s)[(*  -  /r6)TI]“1(s  -  fib)] 


(8) 
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0  500  1  000  1  500 

Mahalanobis  Distance 


Figure  2:  Modeling  thermal  hyperspectral  backgrounds  with  a  t-ECD  relies  on 
estimating  the  heavy-tail  parameter  by  fitting  a  mixture  of  two  F-distributions  into 
the  Mahalanobis  distance. 

provide  good  performance  by  exploiting  statistical  distance  and  angle  separation 
in  the  spectral  space.  The  quantities  ///,  and  S;,  are  maximum  likelihood  estimates 
obtained  from  plume-free  background  clutter.  More  details  about  the  application 
of  these  algorithms  to  hyperspectral  target  detection  and  plume  detection  problems 
can  be  found  in  [3]. 


5  Constant  False  Alarm  Rate  Processor 

The  tails  of  the  plume-free  background  distribution  at  the  output  of  the  matched 
filter  or  ACE  detectors  can  be  modeled  with  sufficient  accuracy  using  the  general¬ 
ized  Pareto  distribution  (GPD)  [4],  Given  a  sufficiently  high  “tail-threshold”  u,  the 
distribution  Fu(z)  =  Pr(X  —  u  <  z\X  >  u)  of  excess  values  z  =  x  —  u  of  x  over 
u,  converges  to  the  GPD 

+  (9) 

\l  -exp(-zfa),  £  =  0 

which  is  defined  for  z  >  0  and  1  +  £.z/ct  >  0.  The  quantities  cr  >  0  and  £  are 
known  as  scale  and  shape  parameters,  respectively.  The  GPD  has  heavy  tails  for 
£  >  0,  exponential  tails  for  £  =  0,  and  a  finite  upper  endpoint  at  — cr/ £  for  £  <  0. 
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Figure  3:  Illustration  of  GPD-based  CFAR  threshold  selection. 


The  parameters  of  this  model  are  estimated  from  the  data  using  the  method  of 
maximum  likelihood.  The  GPD  fitted  to  the  data  can  be  used  to  approximate  the 
tail  of  the  unknown  underlying  distribution.  If  we  denote  by  i)  the  estimate  of  the 
threshold  corresponding  to  a  false  alarm  probability  Pfa,  we  have 


(10) 


where  u  is  the  threshold  used  to  estimate  the  parameters  of  the  GPD  and  a  is  the 
fraction  of  samples  above  this  threshold. 


6  Discrimination  and  Identification  Algorithms 

The  task  of  assigning  a  hit  to  one  of  a  predetermined  number  of  CWA  classes  is 
known  as  discrimination.  When  each  class  consists  of  a  single  CWA  agent,  dis¬ 
crimination  is  known  as  identification.  The  theoretical  framework  for  detection 
and  discrimination  is  the  theory  of  statistical  hypothesis  testing.  Therefore,  de¬ 
tection  and  discrimination  have  some  formal  similarities;  however,  they  also  have 
some  important  differences. 

A  criterion  for  discrimination  performance  should  take  into  consideration  the 
importance  of  different  CWA  threats.  If  all  threats  are  symmetrically  treated,  a 
meaningful  figure  of  merit  is  the  probability  of  correct  discrimination  (  Pen)  de¬ 
fined  by  Pcd  =  Xwc=i  Pf(D  =  sfc|T  =  sk )•  Using  the  signal  model  (3),  the  dis- 
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crimination  problem  can  be  stated  as  testing  between  the  following  p  hypotheses 
(k  =  1 


Hi~  .  x  —  d^Sh  v  rs-/  Nr (dhSh  +  /i-^5  ^5)  (11) 

If  { a,}. .  Sfc,  /Ltb,  S 5}  are  known,  the  I\  n  is  minimized  by  the  maximum  likelihood 
classifier.  This  classifier  computes  the  Mahalanobis  distances  of  the  pixel  under 
test  x  from  each 

^ k  —  l^b  (12) 

and  assigns  a;  to  the  “closest”  (according  to  A/j  CWA.  In  practice,  o^,  /at,  and 
5]/,  have  to  be  estimated  from  the  available  data.  The  generalized  least-squares 
estimate  of  a&  is  given  by 


(13) 


Substitution  into  (12)  provides  a  practical  discrimination  algorithm.  Another  ap¬ 
proach  is  to  use  the  F-test  developed  in  linear  regression  analysis  [1], 


7  Spatial  Distribution  of  False  Alarms 

Figure  4  shows  an  example  of  the  spatial  point  pattern  generated  by  the  top  one 
percent  hits  at  output  of  the  matched  filter  for  a  plume-free  cube  and  its  proba¬ 
bility  distribution.  It  turns  out  that  this  spatial  pattern  follows  a  complete  spatial 
randomness  (CSR)  model.  This  result  and  the  fact  that  plume  pixels  appear  in 
spatial  clusters  allows  the  use  binary  integration,  “M  of  N”  detection,  or  coinci¬ 
dence  detection  to  improve  detection  performance.  Binary  detection  is  used  in  the 
automated  system  as  part  of  the  false  alarm  mitigation  process. 


8  Automated  CWA  Detection  System 

Figure  5  shows  the  basic  components  of  the  automated  CWA  detection/identification 
system.  This  system  has  been  implemented  in  the  form  of  a  flexible  MATLAB  pro¬ 
cessing  pipeline  which  allows  quick  experimentation  with  different  algorithms  and 
data  sets. 

To  illustrate  the  operation  of  the  system  we  use  data  collected  by  a  Telops  FT- 
IR  FIRST  hyperspectral  sensor  on  an  acetic  acid  explosive  release  at  the  Dugway 
Proving  Ground  in  Utah.  The  specific  LWIR  data  set  used  was  taken  on  August 
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Top  1%  of  Matched  Filter  Output  for  Plume-Free  Cube 


Figure  4:  Extreme  values  of  the  matched  filter  detection  statistics  and  the  modeling 
of  their  spatial  distribution  with  the  complete  spatial  randomness  (CSR)  model. 


3rd,  2006  at  approximately  11:30am  in  the  morning.  The  Field-of-View  (FOV) 
of  the  sensor  was  150  x  320  pixels,  with  104  spectral  bands  from  8-11/mi  and  an 
instantaneous  FOV  of  0.342  mrad.  The  ambient  temperature  at  the  time  of  the  re¬ 
lease  was  29.68  degrees  Celsius  (302.85K),  and  the  ambient  relative  humidity  was 
26%.  In  total,  43  hyperspectral  cubes  were  captured  over  a  span  of  3.35  minutes, 
22  of  which  were  captured  pre-release.  There  are  approximately  4-5  seconds  be¬ 
tween  cubes.  The  data  used  has  a  mountainous  background  scene  consisting  of 
three  distinct  regions:  sky,  mountain,  and  field.  As  an  illustration,  Figure  6  shows 
the  output  of  the  matched  filter  for  a  cube  with  an  acetic  acid  plume  present.  Red 
(blue)  indicates  plume  warmer  (colder)  than  the  background.  Movies  demonstrat¬ 
ing  the  operation  and  performance  of  the  system  with  various  data  sets  will  shown 
at  the  conference  presentation. 

9  Summary 

The  objective  of  the  work  reported  in  this  paper  is  to  develop  real-time  capability  to 
detect,  identify,  quantify,  and  track  the  presence  of  chemical  warfare  agent  threats 
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Figure  5:  Automated  signal  processing  system  for  hyperspectral  chemical  plume 
detection  and  identification. 


Matched  filter  outDut  statistics 


Figure  6:  Example  of  matched  filter  output  detection  statistics. 


at  physiologically  significant  levels.  We  have  developed  and  implemented  in  MAT- 
LAB  a  fully  automated  system  for  detection  and  identification  of  chemical  plumes. 
The  performance  of  the  system  has  been  evaluated  with  data  collected  by  the  US 
Army,  Edgewood  Chemical  and  Biological  Center,  for  various  types  of  chemical 
agents  and  backgrounds. 


Acknowledgement 

This  work  is  sponsored  by  Defense  Threat  Reduction  Agency  under  Air  Force 
Contract  FA8721-05-C-0002.  Opinions,  interpretations,  conclusions,  and  recom¬ 
mendations  are  those  of  the  author  and  not  necessarily  endorsed  by  the  United 


RTO-MP-SET-151 


2-9 


UNCLASSIFIED/UNLIMITED 


UNCLASSIFIED/UNLIMITED 


Standoff  Detection  and  Identification  of  Chemical 
Plumes  with  Long  Wave  Hyperspectral  Imaging  Sensors 


States  Government.  We  wish  to  express  our  gratitude  to  Dr.  Ngai  Wong,  Detection 
CAPO,  JSTO-CBD,  for  his  enthusiastic  support. 


References 

[1]  D.  Manolakis.  Statistical  quality  assessment  criteria  for  a  linear  mixing  model 
with  elliptical  t-distribution  errors.  In  Proc.  SPIE  5546,  Orlando,  FL,  2004. 
SPIE. 

[2]  D.  Manolakis  and  F.  D’Amico.  Design  and  evaluation  of  hyperspectral  algo¬ 
rithms  for  chemical  warfare  agent  detection.  In  Proc.  SPIE  5995,  Orlando,  FL, 
2005.  SPIE. 

[3]  D.  Manolakis  and  G.  Shaw.  Detection  algorithms  for  hyperspectral  imaging 
application.  IEEE  Signal  Processing  Magazine,  pages  29—43,  January  2002. 

[4]  D.  Manolakis,  D.  Zhang,  M.  Rossacci,  R.  Lockwood,  T.  Cooley,  and  J.  Ja¬ 
cobson.  Maintaining  CFAR  operation  in  hyperspectral  target  detection  using 
extreme  value  distributions.  In  Proc.  SPIE  6565,  Orlando,  FL,  April  2007. 

[5]  A.  Villemaire  M.  Chamberland  P.  Lagueux  V.  Farley,  A.  Vallieres  and 
J.  Giroux.  Chemical  agent  detection  and  identification  with  a  hyperspec¬ 
tral  imaging  infrared  sensor.  In  Electro-Optical  Remote  Sensing,  Detection, 
and  Photonic  Technologies  and  Tlieir  Applications,  pages  10. 1 1 17-12.736864. 
SPIE,  2007. 


2  - 10 


RTO-MP-SET-151 


UNCLASSIFIED/UNLIMITED 


